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We  consider  preemptive  scheduling  of  N tasks  on  m processors; 
processors  have  different  speeds,  tasks  require  amounts  of  work  which 
are  exponentially  distributed,  with  different  parameters.  The  policies 
of  assigning  at  every  moment  the  task  with  shortest  (longest)  expected 
processing  time  among  those  not  yet  completed  to  the  fastest  processor 
available,  2nd  shortest  (longest)  to  the  2nd  fastest  etc.,  are  examined, 
and  shown  to  minimize  expected  values  of  various  cost  functions.  As 
special  cases  we  obtain  policies  which  minimize  expected  flowtime, 
expected  makespan  and  expected  lifetime  of  a series  system  with  m 
component  locations  and  N spares, 
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SCHEDULING  TASKS  WITH  EXPONENTIAL  SERVICE  TIMES  ON  NONIDENTICAL 
PROCESSORS  TO  MINIMIZE  VARIOUS  COST  FUNCTIONS 


Gideon  Weiss  and  Michael  Pinedo 


1 . INTRODUCTION 


Consider  Che  following  situation:  processors  1,  ....  m are  available 
to  process  tasks  1,  N . Task  j needs  an  amount  X^  of  processing, 

where  X^  is  a random  variable  with  an  exponential  distribution,  with 
parameter  A^  . The  processing  can  be  done  by  any  of  the  processors,  and 
preemptions  and  switches  of  processors  are  allowed.  Processor  i has 
speed  s^  . The  processing  of  task  j requires  for  completion  a total 
time  of  t.,  ...»  t on  processors  1,  ...»  m respectively,  so  that 
t.s,  + •••  + t s * X.  . X,,...,X  are  assumed  to  be  independent 
of  each  other,  and  independent  of  the  manner  in  which  processors  are 
assigned  to  tasks.  Starting  at  time  0 , a cost  per  unit  time  g{U} 
is  incurred  at  time  t , where  {U}  C {1,  ...,  N}  is  the  set  of  un- 
completed tasks  at  t . Thus  for  every  scheduling  rule  (which  determines 
for  every  {U}  C {1,  ....  n}  of  uncompleted  tasks  at  t , which  of  the 
tasks  should  be  processed  on  which  processor)  there  is  an  expected  cost 
over  [0,°°)  . We  want  to  find  a scheduling  rule,  which  minimizes  the 


expected  cost. 


Let  (U)  * {j.,  ....  j.}  where  A > A > •••  > A . We  consider 
1 K Ji  $2  ^k 

two  rules  in  particular:  SEPT  requires  task  j to  be  processed  on  processor 
i , for  i <_  min  (k,m)  ; LEPT  requires  task  on  processor  i for 

i <_  min  (k,m)  . In  other  words,  both  rules  use  only  the  fastest  processors, 


2 


and  process  on  them  tasks  ordered  by  their  expected  length;  SEPT  assigns 

the  task  with  the  Shortest  Expected  Processing  Time  to  the  fastest  processor, 

LEPT  assigns  the  task  with  the  Longest  Expected  Processing  Time  to  the 

fastest  processor.  We  find  for  a variety  of  cost  rates  g that  SEPT 

or  LEPT  minimizes  the  expected  total  cost. 

In  particular  we  find  SEPT  is  optimal  for  the  following  scheduling 

problems:  to  minimize  the  sum  of  completion  times  (flow  time);  to 

minimize  the  weighted  sum  of  completion  times  where  the  weight  of  the 

completion  of  task  i is  w.  , and  whenever  X . > X,  , we  have  w,  > w.  ; 

J j k j k 

and  to  minimize  the  sum  of  the  first  k completion  times.  LEPT  is 
optimal  for  these  scheduling  problems:  to  minimize  the  last  completion 
time  (makespan) ; and  to  minimize  the  total  amount  of  processing  (times 
multiplied  by  speeds)  done  by  processors  1,  ...,  r , (r  £ m)  , when 
it  is  assumed  that  for  any  k <_  m processors  1,  ....  k are  used  as 
long  as  | U | >_  k . 

The  situation  described  above  can  also  be  interpreted  as  a reliability 

problem,  assuming  a system  with  m component  locations,  and  N spares. 

Component  location  i causes  the  spare  to  wear  out  at  rate  s^  . When 

spare  j operates  in  locations  1,  ...»  m for  total  times  t, , . . . , t , 

1 m 


betore  it  fails,  then  X. 

J 


Vl  + 


+ t s , and  X.  has  exponential 
mm  j r 


distribution  with  rate  X^  . We  show  that  if  the  system  is  a series 
system,  then  putting  the  best  component  (smallest  X)  in  the  location 
with  highest  wearout,  the  second  best  in  second  highest  wearout  location, 
etc.,  (the  equivalent  of  LEPT)  maximizes  the  expected  system  lifetime. 
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The  present  paper  generalizes  results  of  [2],  [3],  [5],  which 
deal  only  with  identical  processors,  and  with  the  minimization  of  flow- 
time and  of  makespan.  Bruno  and  Downey  [2]  seem  to  have  the  earliest 
results,  showing  that  SEPT  and  LEPT  minimize  flowtime  and  makespan  for 
two  (m  = 2)  identical  processors.  Frederickson  [3]  generalizes  these 
results  to  any  m identical  processors.  In  the  present  paper  we  follow 
some  of  the  derivations  used  by  Frederickson,  but  we  use  a more  streamlined 
dynamic  programming  formulation  which  dispenses  with  some  of  the  exchange 
arguments  used  by  Frederickson  and  by  Bruno  and  Downey.  A slightly 
different  dynamic  programming  formulation  is  used  by  Van  der  Heyde  [5] 
to  show  that  LEPT  minimizes  makespan  for  m identical  processors. 

Pinedo  and  Weiss  [4]  use  a different  method  to  prove  that  LEPT  minimizes 
makespan  for  m = 2 identical  processors  and  also  discuss  a case  in 
which  the  amount  of  processing  has  a hyperexponential  distribution. 

Eugene  L.  Lawler  (private  communication)  has  suggested  the  investigation 
of  nonidentical  processors,  and  Sheldon  M.  Ross  has  suggested  the  reli- 
ability problem. 

The  paper  is  organized  as  follows:  Section  2 contains  a formulation 
of  the  problem  as  a dynamic  programming  problem  and  a derivation  of  a 
necessary  and  of  a sufficient  condition  for  the  optimality  of  a priority 
policy.  Section  3 and  4 contain  sufficient  conditions  on  the  cost  rate  g 
under  which  SEPT  or  LEPT  are  optimal.  Section  5 lists  the  applications 
of  Section  3 and  4,  and  some  counterexamples.  A discussion  of  the  suffi- 
cient conditions,  and  of  some  open  problems  is  contained  in  Section  6. 


• 
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2.  DYNAMIC  PROGRAMMING  FORMULATION  AND  CONDITIONS  OF  OPTIMALITY 

At  time  t = 0 we  have  tasks  {1,  N}  and  processors 

{1,  . . . , m}  . We  order  the  processors  to  have  s.  > s„  > • • • > s 

1 — 2 — — m 

We  shall  assume  throughout  that  m >_  N . Most  practical  situations 
can  be  reformulated  so  as  to  have  m >_  N by  adding  processors  with 
speeds  s = 0 . Tasks  {1,  . . . , N}  are  then  assigned  to  processors, 
and  processed  until  a task  is  completed,  and  a new  assignment  of  processors 
is  chosen.  We  consider  t = 0 and  the  times  at  which  tasks  are  completed 
as  decision  moments.  The  state  U at  a decision  moment  is  the  set  of 
uncompleted  tasks,  U C {1,  ...,  N}  . The  set  of  actions  available  in 
state  U , J(U)  is  defined  as: 

J(U)  = {f  | f is  a 1-1  function  from  U into  {1,  ...,  m}}  . 


For  state  U and  action  f on  J (U)  , the  next  decision  moment  occurs 

time  T later,  where  T is  an  exponential  random  variable  with  rate 

A (U)  = £ A s,,,>  . The  state  at  the  next  decision  moment  is  U' 

* jeU  2 

where: 


P(U’ 


U - {k}) 


Ak3f(k) 

Af(U) 


k e U . 


The  cost  incurred  between  the  two  decision  moments  is  g(U)  • T , where 
g is  a set  function,  with  g(<f>)  = 0 . 

Note  that  at  decision  moment  t and  state  U , the  effect  of  the 
choice  of  action  f does  not  depend  on  the  state  at  t , t e [0,t)  . 
This  corresponds  to  the  situation  described  in  the  introduction,  because 
of  the  memoryless  property  of  the  exponential  distribution. 
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At  each  decision  moment  t , when  the  state  is  U , a policy  tt 

specifies  which  action  from  J(U)  should  be  taken.  We  use  G (U,t) 

v 

to  denote  the  expected  value  of  the  cost  incurred  over  (t,°°)  , starting 

with  state  U at  the  decision  moment  t and  using  policy  tt  . We 
* 

wish  to  find  tt  which  minimizes  G^({1,  N},0)  . At  time  t and 

state  U a stationary  policy  will  choose  an  action  from  J(U)  independent 
of  t . For  such  policies  G^(U,t)  = G^(U,0)  ; we  will  use  G^(U)  t0 
denote  G (U,0)  . The  calculation  of  the  expected  cost  G (U)  , when  tt 

7T  TT 

chooses  action  f at  U can  be  done  using  the  recursion  relation: 


8W)  * A,  Yf()>Vu  - <1» 


g (u)  = 

TT 


Af  (U) 


We  call  an  action  f e J(U)  fast  if  for  |u|  = n f is  1-1  from 

U to  1,  ....  n . A policy  tt  is  fast  if  it  uses  only  fast  actions 

(i.e.,  since  i s2  i L sm  only  the  fastest  processors  are  used). 

We  will  call  a policy  a priority  policy  if  for  some  particular  renumbering 

of  the  tasks  as  {1,  ....  N)  , for  every  state  U = { 1^ , ...»  ifl}  where 

i < ...  < i , tt  takes  the  action  f(i.)  = i ,1=1,  ...,n. 

1 n j J J ’ 

Let  tt  be  a priority  policy.  Let  U be  an  arbitrary  fixed  subset 

of  {1,  ...»  N}  . We  shall  make  the  following  simplifications  in  notation: 

we  shall  renumber  the  tasks  in  U , in  order  of  their  priorities  according 

to  tt  , as  U = {1,  ....  n}  . Thus  the  action  f chosen  by  tt  at  U 

will  be  f(j)  = j for  j = 1,  ....  n . We  shall  also  use  the  following 

notations:  let  A = A,(U)  , G = G (U)  , G.  = G (U  - { k } ) , 

t w k w 

k-1  n 

A.  ” l x s,  + y A s . - A,(U  - {k})  , g = g(U)  , g,  - g(U  - {k})  , 
j-1  J J j-k+1  J J"1  1 

and  G^?  * (U  - {k,i})  . The  recursion  (1)  in  this  notation  gives: 


i 


■ ■ 


a*” 
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(2) 


n 

+ I 
lr\. 


X.sG 
J j j 


k-1 


(3) 


So  far  we  have  discussed  policies  which  allow  decisions  only  at 

t = 0 and  at  task  completion  times;  we  denote  these  by  P . We  could 

also  consider  a much  wider  class  of  policies,  P , which  allows  decisions 

at  any  time  t e [ 0 , °°)  . The  action  space  for  these  policies,  at  each  t , 

and  in  the  state  U , would  still  be  J(U)  . We  note  then  that  IP  in- 

o 

eludes  all  the  stationary  policies  in  P . We  will  not  consider  P , 
because  of  difficulties  in  defining  the  process  under  general  tt  e P . 
Instead  we  will  consider  for  a fixed  A the  class  P^  of  policies  which 
allow  decisions  at  0,A,2A,  ....  and  at  task  completions.  In  Pfi  by 


[1] 
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there  exist  optimal  policies,  there  exists  a stationary  optimal  policy, 
and  a necessary  and  sufficient  condition  for  7T  to  be  optimal  is 
that  tt  is  excessive.  If  it  is  stationary  (that  is  tt  e F ) it 
will  then  be  optimal  in  P 

o 

We  say  that  policy  tt  is  excessive  in  P^  if  for  any  decision 
moment  t and  any  state  U , we  can  show  that  for  all  f e J(U)  , 

Gc | (U,t)  > G (U,t)  . Here  Gc  \ (U,t)  is  the  expected  cost  of  taking 

t I TT  — 7T  t | IT 

action  f at  t , and  continuing  with  policy  tt  from  the  next  decision 
onwards . 

To  check  that  a stationary  policy  tt  e P^  is  optimal  among  all 

of  P it  is  therefore  sufficient  to  check  that  there  exists  A such 
o 

that  for  every  6 < A , every  state  U , and  every  f e J(U)  , 

G, i (U)  > G (U)  where  action  f is  taken  from  0 to  6 or  the  first 

f | TT  IT 

completion,  which  ever  comes  first,  and  tt  is  used  from  then  on. 

We  derive  now  a condition  for  the  optimality  of  a priority  policy  it  . 


Theorem  1: 

Let  tt  be  a priority  policy.  Assume  s^  > S2  > ‘ ‘ * > s^  > 0 , 
m > N . 


(i)  tt  is  a unique  optimal  policy  if  for  every  arbitrary  fixed  U : 

(4)  G - Gk  > 0 k = 1,  . . . , n . 

(5)  Xk(G  - Gk)  - Afc(G  - G^)  > 0 k < l . 


(ii) 


Conditions  (4),  (5)  as  weak  inequalities  are  necessary  for  the 
optimality  of  it  . 
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Proof : 

(i)  We  want  to  show  that  there  exists  A such  that  if  6 < A , 

for  any  action  f'  e J(U)  if  f'  is  taken  from  0 to  the 

minimum  of  6 and  the  first  completion,  and  tt  is  used  from 

then  on,  then  (4)  and  (5)  imply  > G . This  will  imply 

strong  excessivity  of  it  in  P^  , and  hence  unique  optimality 

in  P.  and  therefore  in  P . For  an  arbitrary  action  f' 

A o J 

in  J(U)  , we  can  write 

(6)  Gft|ff  = 5 • g + l 6X.sfl(j)G.  + (1  - l «VjSf(j))G  + o(6)  . 

The  term  o(6)  includes  costs  incurred  over  (0,6)  when  there 
is  an  event  in  (0,6)  , costs  incurred  over  (5,°°)  if  there  is 
more  than  1 event  in  (0,6)  , and  correction  terms  for  the 
probabilities  that  no  event  occurs  in  (0,5)  or  that  task  j 
is  completed  in  (0,5)  . 

Assume  f'  ^ f . We  will  look  at  two  cases: 

Case  1: 

There  exists  k < n such  that  f'(j)  t k for  any  j . In  that 

case  there  exists  i such  that  f'(i)  = V.  > n . We  have  s^  > s?  . 

Define 

j £'(J)  J * i 

f"(j)  = 

fk  j = i . 
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Case  2: 

’f(l),  f(n)}  = {1,  . . . , n}  . In  this  case  there  exists 

1 _<  k < 4 <_  n such  that  f ’ (k)  > f ' (4)  . Let  s. 


f'(k) 


Sf'(4)  “ s"  » where  s''  > s'  . Define: 


(f'U)  J * k,  4 

f"(j)  = ! f ' (k)  j = 4 
(f'U)  j = k . 


We  use  (6)  to  obtain,  in  Case  1 


(7) 


Gf  ' | IT  “ Gf  " | TT  = 6Xi(Sk  " Si)<;G  “ Gi^  + °(5) 


and  in  Case  2 

(8)  Gf , jw  - GfII|T  = 5(s"  - s')(Xk(G  - 6fc)  - ^(G  - G^))  + o(6)  . 

By  (4)  and  (5)  and  by  sk  > s;  , s " > s ' , we  then  have: 

Gf'|1r  ~ G£  I ’ | TT  = *K  + 0(<5)  » K > 0 . 

By  repeating  this  argument  for  f"  and  obtaining  f ’ ' ' etc.,  we  get 
in  a finite  number  of  steps  action  f . So  we  have: 


Gf'U 


G = 6K,  + o (6) 

TT  1 


K > 0 


- G > 0 . 


and  we  can  now  find  A , such  that  for  all  6 < A.,  , G,.i 

r f f j 7T  7T 

Repeating  for  all  actions  in  J(U)  (which  is  finite)  we  obtain 

A = min  A for  which  G . - G > 0 , for  all  6 < A , f,  e J(u) 

f ^eJ  (U)  rl  f 1 1 11  * 1 


■ 


-V,  ; 


I 


B 


i 
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(ii)  Assume  now,  in  contradiction  to  the  weak  inequalities  (4),  (5) 
that : 

Case  1:  G - G,  < 0 for  some  k or: 
k 

Case  2:  A^(G  - G^)  - X?(G  - G?)  <0  for  some  k < l . 

We  can  define  in  Case  1: 


( j 

j * k 

f'(j)  = 

(m  > N > 

n) 

1 m 

j = k 

and  in  Case  2: 

0 

j 

i k,£ 

f’(j) 

r 

j 

= i 

(t 

j 

= k 

and  use  (7)  or  (8)  to  show  G^ , 

'i/u)  - 

G 

<0  for 

6 small  enough,  which 

contradicts  the  optimality.  ■ 

' 

; 
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3.  OPTIMALITY  OF  SEPT  POLICIES 

Let  the  tasks  be  ordered  by  A,  > X > • • • > A and  let  it  be 

i L — — N 

the  priority  policy  for  that  ordering;  it  is  a SEPT  policy. 

Lemma  1 : 

Let  it  be  a priority  policy.  Assume  g($)  = 0 and  g(U)  >_  g(V)  if 
U D V . Then,  for  arbitrary  fixed  u (with  the  above  simplified  notation), 

(9)  G - Gk  > 0 k - 1,  ....  n , 

and  g(U)  > g(V)  if  U D V implies: 

(10)  G-Gk>0  k = 1,  ...,  n . 


Proof : 

The  proof  is  by  induction  on  n , the  size  of  U 

Induction  Base,  n = 2 : 

For  n = 2 , we  have: 


§{1,2}  + A^s^G^  + A2S2G9 

Vl  + x2s2 


§{  2 } 


1 x2si 


sill 

A1S1 


So 


1 ‘ - Tx  8(21  + 5^7  «»>)/<V1  + l2*2> 

1 <g{l,2}  - g{2})/(AlSl  + A2s2)  > 0 
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G - G2  = 


= |g{  1,2}  + g{  2}  - g{l}j/(XlSl 


+ X2s2)  1 


>_  (g{  1,2}  - gd})/^^  + X2s2)  > 


General  n 


We  will  show  the  induction  argument  which  proves  (10) . The  proof 
for  (9)  is  similar.  We  shall  assume  that  (10)  holds  for  sets  of  size 
< n - 1 . Write: 


X.  s.  X . s . 

G = f + G + l G . 

A A k ,ik  A j 


g,  A - A.  k-1  X.s.  n X.s.  .. 

(12)  G.  = + — 7 — — G + T G + l G 

k A A k ,L.  A jk  A jk 

3=1  j=k+l 


So  (noting  Xksk  + Afc  - A = 


= l VVl  " *A 

j=k+l  J 3 3 ) 


g-g,  X.s.  n X (s  - s . ) 

0 - S ■ -r*  * l -V-  - V + J d J - V * 0 


since  g > g , s . . >_  s . and  G > G , G,  > G.,  by  the  induction 
k J~i  J J Jk  k jk 


assumption. 


We  now  prove 


Theorem  2: 


The  SEPT  policy  is  is  optimal  if  g satisfies,  for  every 


U C {1,  ....  N) 


13 


I 

r 


(13)  g(<|>)  - 0 , g(U)  > 0 . 

(14)  g(U  - UJ)  >_  g(U  - {k> ) k < l , k , ft  t U . 

(15)  g(U)  - g (U  - {k})  - g(U  - U»  + g (U  - (k,D)  >0  k , ft  e U . 

Proof : 

We  note  first  by  (13)  and  (15)  that 

(16)  G(U)  >_  G(V)  for  U D V . 

Assume  first  that  X > X > • • • > X > 0 , s,  > s„  > •••  > s > 0 , m > N , and 

1 2.  N 1 Z m 

that  (13)  - (15)  and  hence  (16)  hold  as  strict  inequalities.  We  then 
show  that  it  is  the  unique  optimal  policy. 

Let  U be  an  arbitrary  fixed  subset  of  {1,  ....  N}  then  we  know 
from  the  preceding  lemma  that  (10)  holds.  Using  the  above  simplified 
notation  we  now  will  show: 

<17)  0 - S - ai  * > 0 ■ 

(18)  - Gk-1>  - ‘k(G  - Gk>  ’ 0 ' 

The  proof  is  by  induction  on  n , the  size  of  U . 

Induction  Base,  n » 2 : 

For  n » 2 we  have  (noting  that  G^  = 0)  : 


G - G1  - g2 


gf.1,2}  - g{l}  - g( 2} 

1 

^ X ^ s 


> 0 


v 


■ 
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which  proves  (17)  and 


X1(G"G1)  ~ ^2(G-G2)  = 


~ A^s^l^}  " + s2)  (A^g{ 2 } - A 2g{  1 } ) 


(X1s1  + X2s2)s1 


(19) 


(A^  + A2s9)g{l}  - (A2s1  + A^s2)g{2> 


(^lsl  + A2s2)s1 


(\1  - A2)(Sl  - s2)g{2) 
(A1s1  + A2s2)s1 


> 0 


which  proves  (18) . 


General  n : 

We  shall  assume  (17)  and  (18)  hold  for  sets  of  size  <_  n - 1 . 
To  prove  (17)  write: 


8„  A - A.  l-l  . 

<20)  °t ' i + — °t  + l 0 + ? V-i-i G 

i-1  » 3«  j.{+1  A 


(21)  G 


8k l A ~ A 


kl 


kS.  A 


g,  . + y 

1 rl  l* 


k- 1 A . s . 


kl  ^ A jk£ 


l-l  As. 

♦ l 


j=k+l 


A jki. 


n X<S.  i 

y -Li=2.  G 

A A jki 


j-Jl+1 


We  have,  substituting  (11),  (12),  (20),  (21): 


A(G  - Gk  - Gi  + Gk*}  = (g  - 8k  - 8i  + 8k*} 

+ 1 Wgj  -Gjk-°J*  + V> 


j#k,H 


+ j.L  v*i-i  ' sJ)<Gt ' ^ ' G“ + v} 

+ j.tiXi<*J-1“j><0‘"!3‘‘G“  + GJ“> 

+ X “ Sj)Uj<Gk«  ' Gjkt)  ' Xj+l(Gkn  ' Gj+lkl)1 


+ X (s  - - s ) (G,  - G ) > 0 
n n-1  n k kn 


since  all  terms  are  > 0 , the  first  by  (15),  the  next  three  by  (17) 
for  (n-1)  , the  fifth  by  (18)  for  (n-1)  , the  last  by 


(10). 


To  prove  (18)  write: 


xjsjuk-i<Gj  - Gjk-i>  - \(Gj  ‘ V 


+ j.L  xj*j-i{xk-i<ci  - Gjk-i>  - xk(cj  - v> 

= (^k— i ~ ^k^  |AG  ~ 8 — iGk  i — ^kskGk 


u 

+ E Ysj-1  ■ sj 

j-k+1  J J J 


)Gj(  " Xk-l{\-lGk-l  ” 8k-l 


XkSk-lGk-lk'  + VAkGk  “ 8k  ' Xk-lSk-lGk-lk} 


Hence  by  rearranging  and  collecting  terms: 


■ ' Ci.?  : w.  • 


IJf 


i 


16 


Vuk-i<0  - <W  - v°  - v> 


k-2 

1 


(23) 


^ VA-iwj  'V-i'-VV'-i' 

+ X Vi-i‘Vi(c)  - V-i>  - Vc3  -Jk 
k-i  - v[ 


jk' 

^ - G,, .)} 


i Ak-1  , Ak  I 

I ' Vl  - \ ^ \-l  - \ 8M 


-!jkV)-v-X  wvj]  • 

The  first  two  terms  are  positive  by  (18)  for  (n  - 1)  . We  still  need 
to  show: 


g - 


k-1 


(X,.  , - X,  ) gk-l  + X,  - X,  gk 


k-1  k' 


(24) 


k-1  k 


U LI 

> l X s (G  - G ) - l X s (G  - G ) 
j=k  J 3 J j-k+1  J J 


By  (14) 


g “ 


k-1 


+ 


X,.  , - X,.  6k-i  x,.  , - X,  Kk 


iy,  > g - g. 


k-1  k 


k-1  k 


but : 


g - AG  - l X s G - l X s (G  - G ) 
j=l  J J J j = 1 J J J 


k-1 


ek  ■ ^ ws  - v * xjsj-i<Gk  - v 
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so : 


g ' g,. 


u u 

= y A s . (G  - G . ) - y A.s.  . (G  - G. 

3 3 3 3 J-l  3 


j=k 


j=k+l 


k-1 


+ y A . s (G  - G - G + G ) 

J J J k jk 


+ j.L  Vj-i(o  ' gj  * ^ + v • 


but  the  last  two  terms  are  positive  by  (17)  for  (n  - 1)  , which  proves 
(24)  and  hence  (18).  By  Theorem  1,  (10)  and  (18)  imply  that  t is 
uniquely  optimal. 

Suppose  now  we  only  have  s^  > 0 , A^  >_  •••  A^  , and 

(13),  (14)  and  (15)  only  hold  as  weak  inequalities.  We  can  perturb 

A's  , s's  and  g very  slightly  to  get  strong  inequalities.  For  the 

perturbed  problem,  let  G^,(U)  be  the  expected  cost  under  stationary 

it'  e IP  (of  which  there  are  a finite  number).  Then  GC(U)  < Ge,(U) 
o ” 


for  all  stationary  ir'  e P 


it  tt  1 

Letting  the  perturbation  approach  zero. 


we  obtain  G (U)  < G , (U)  , so  tt  is  optimal  (possibly  not  unique) 

TT  — TT 

in  P . ■ 


- . . . 1W/1  ; „ ' .. 


18 
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) 

\\ 

U.  OPTIMALITY  OF  LEPT  POLICIES  ■ 

Let  tasks  1,  ....  N be  ordered  so  that  < X0  < •••  < X , 

1 — i — — n 

and  let  it  be  the  priority  policy  for  that  ordering;  tt  is  a LEPT 

policy . 

Theorem  3: 

The  LEPT  policy  tt  is  optimal  if  g is  of  the  form: 

(25)  g(U)  = c.D|  , 

\ 

where : 

(26)  cq  = 0 , c^  >_  ck_^  k = 1,2,  . . . , N , 

and  the  c^'s  satisfy: 

Ck  ” Ck-1  Ck-1  ~ Ck-2  « 

(27)  — — < — k = 2,  ....  N , 

s,  — s.  .. 

k k-1 

(where  we  let  0/0  stand  for  0). 

Proof : | 

We  shall  again  assume  strong  inequalities  in  (26)  and  (27),  and 

that  s,  > s„  > •••  > s >0,m>N,  and  A<  < •••  < X . We 
12  m 12  n 

will  show  that  tt  is  uniquely  optimal.  A perturbation  argument  as  in 
Theorem  2 then  implies  optimality  of  it  for  weak  inequalities.  We 
consider  again  an  arbitrary  fixed  U , using  the  simplified  notation 
described  above. 
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We  note  that  g(U)  > g(V)  > g(<J>)  = 0 if  U D V ^ <J>  . Hence  by  Lemma  1, 

G - G >0  for  all  k . 
k 

We  now  show  that 


(28) 


\-l(G  ‘ Gk-1}  " VG  " V * ° k = 2 , . . . , n 


by  induction  on  n . 


Induction  Base,  n = 2 : 


We  obtain  as  in  (19) 


X^G  - Gx)  - X2(G  - G2) 


(s 


L + s2)(X2g{l}  - Xlg{2>)  - (X2  - X1)s1g{l,2} 
(XiS  + X2s2)s1 

(X2  - X^) { (s^  + s2)c^  - Sj^} 

(Xlsl  + X2S2^S1 


C2  C1  ci  cn 

but,  by  (27),  — < — ± , cn  = 0 , so: 

s2  S1  0 


S1C2  < (sl  + S2)C1 


and  (28)  follows. 


General  n : 


We  assume  (28)  holds  for  sets  of  size  (n  - 1)  . We  rewrite 


(23),  noting  that  Xfc  > X , g - j 


k-1 


, . - X.  sk-l  X,  - X,  6k 
k-1  k k-1  k 


81, 


c^  - cn_^  » and  rearranging  the  last  term,  as: 


— — — 
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Wi(G  - - VG  - Gk)  = 


k-2 


(29) 


l A.s  .{A,  ,(G.  - G..  .)  - A (G.  - G..  } + 
>1  3 J k"l  J jk-l  k J Jk 


j.L  vi>- - v1  + 


y S.  ,{A.  . (G  - G.  .)  - A.(G  - G.)}  + 

j-k+1  J'1  J_1  J_1  J J 


A s (G  - G ) - (c  -c  ,) 
n n n n n-1 


The  first  two  summations  are  positive  by  the  induction  hypothesis.  We 
shall  show  that 


(30) 


A s (G 
n n 


G ) 
n 


(c  - c ) 
n n-1 


which  will  be  sufficient  to  prove  (28)  for  k = n . Assuming  then  (as 

an  inner  induction  hypothesis)  that  (28)  holds  for  n,n  - 1,  ...»  k + 1 , 

the  third  summation  will  be  positive,  and  so  (28)  will  follow  for  k . 

To  show  (30)  we  calculate  G - G . We  note  that  because  it  is  a 

n 

priority  policy,  the  completion  times  of  tasks  1,  ...,  n - 1 are  the 
same  whether  we  start  with  tasks  1,  ....  n or  with  tasks  1,  ...,  n - 1 

at  t = 0 . Let  V(t)  , t e [0,<*>)  , be  the  subset  of  {1,  ...,  n - 1} 

of  uncompleted  tasks  at  time  t , when  V(0)  = {1,  ...,  n - 1}  . 

oo 

G-G  is  then  the  expec  ted  value  of  f [g(V(t)  U {n})  - g(V(t))]dt  . 
n n 

Assume  that  tasks  1,  ...,  n - 1 ipleted  in  the  order 

i,  , . . . , i , , at  times  0 < *■  .«<•••<  t ,»t  = 0.  Then: 

1 n-i  2 n-1  o 


i 
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G - G = 
n 


gU. i , ,n}  - g{i  , . . . , i ] 

1 n-1 I n- 1 


X s 

n n 


l1  ' * / 


g{i  , . . . , i n}  - g{i  . . . , i } 
l n-1  2 n-1 


AS  , 

n n-1 


I,  -Vn-l''!-1!1)  -X„Vl 

l1  ■ e h 


S ^ . i » •••  9 i i * n } — 8 ^ , i * •••  $ i -ll  / ^ o ) 

4-  k+l n-1 k+1 n-1  ( i _ e n n”k  k+1  k 

X s ’ 

n n-k 


k-l  s , (t . . ,-t .) 

n e n n-j  j+1  3 

j=0 


+ • • • 


+ S.L"}  - nn2  e AnSn-j(Cj+l  V 

AnSl  j=0 


In  Che  case  described  above,  g{i  , i ,n}  - g{l  ....  i ,}  = 

k.ti  n— 1 k+i  n-1 

°n-k  - Vk-l  • B*  (27>’  < s Cn"k"1  f°r  k = •••*  n - 1 ■ 

n n-k 

Cn  “ Cn-1 

so  by  substituting  the  expression  would  decrease.  The  terms 

n 

c , “ c , , 
n— k n— k— 1 

multiplying  - - , k=0,  n-1  add  up  to  1 , and  so  we  have 

n n-k 


G - G > 


c - c 
n n-1 


n As 

n n 


which  proves  (30)  and  the  theorem.  ■ 


I 
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5.  APPLICATIONS 

In  this  section  we  list  some  problems  that  are  optimized  by  SEPT 

or  LEPT.  In  general  we  note  that  for  the  special  case  where  s,  = • • * = s , 

1 m 

N > in  , SEPT  and  LEPT  are  nonpreempt ive . When  s,  > •••  > s preemptions 

i m 

will  be  needed.  Thus  in  the  following  problems,  when  s,  = • • • = s , 

1 m 

N > m , we  show  SEPT  or  LEPT  to  be  optimal  in  the  class  of  nonpreempt ive 
policies.  Also,  by  adding  enough  processors  with  speed  0 , we  see 
that  some  of  these  will  not  be  used  by  the  optimal  policies.  Hence  the 
SEPT  and  LEPT  remain  optimal  when  we  allow  insertions  of  idle  time. 

(1)  SEPT  Minimizes  Expected  Flow  Time 

We  denote  by  C ,C  ...,  C the  completion  times  of  jobs  1,  ...,  N , 

1 Z N 

and  by  0 <_  T^  • • • <_  T^  the  completion  times  in  their  order  of  occurrence. 
The  expected  flow  time  of  a policy  it  is 

p*-E(i  c«)  = e(X  tJ- 

The  cost  rate  that  yields  this  is: 

g(U)  = |U i , 

and  it  is  easily  seen  that  g satisfies  the  conditions  of  Theorem  3. 

(2)  SEPT  Minimizes  the  Expected  Sum  of  the  First  k Completions 
We  define 

k = 1,2 N . 


* 
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The  cost  rate  which  vields  this  is 


g(L') 


| 1 U | - (n  - k)  for  |u|  > (n  - k) 
1 0 for  | U | < (n  - k) 


which  satisfies  the  conditions  of  Theorem  3. 


(3)  SEPT  Minimizes  the  Expected  Weighted  Sum  of  Completion  Times 
(Agreeable  Weights) 


Let  a cost  of  w^  >_  0 per  unit  time  be  associated  with  task  j , 


that  is 


We  call  the  costs  "agreeable"  if  \ > X =*•  w >_  w . The  appropriate 

cost  rate  is 


g(U) 


I w.  • 
jeU  J 


The  priority  ordering  to  be  used  is  1,  ....  N , such  that  > A,  , 

k k+1 


and  if 


Xk+1  ’ Wk  — Wk+1  * k = 1>  •••.N-l  . Obviously  g(<p)  = 0 , 


g(U)  >_  0 , g(U  - {i})  - g(U  - { k } ) = WK  - wj  > 0 for  k < i , and 
g(U)  - g(U  - { k } ) - g(U  - {£})  + g(U  - {k,4})  = 0 , so  Theorem  3 applies. 
Case  1 above  is  a special  case  of  this  problem  with  w^  = 1 , 

Case  2 is  not  a special  case  of  this  problem.  A different  special  case 
is  the  sum  of  completion  times  of  the  k shortest  tasks,  obtained  by 


'1 


Wk  = 1 ’ Wk+1 


WN  = 0 • 
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(4)  SEPT  or  the  "cu"  Rule  Do  Not  Minimize  the  Expected  Weighted 
Sum  of  Completion  Times  In  General 

The  "cu"  rule  is  the  priority  policy  which  arranges  the  tasks  as 

1,  ....  N with  wJ,  > w„A„  > •••  > w A,  . When  weights  are  "agreeable" 
11—22—  — NN 

it  coincides  with  SEPT.  The  following  two  counter-examples  show  that 
neither  SEPT  nor  "cu"  are  optimal  in  general. 

(i)  n = 3 , s^  = S£  = 1 » s^  = 0 (identical  processors) 

A!  = 3 ”1  " 3 

A 2 = 3 w2  = 1 

X = 1 w = 2 

3 3 


12  = + 3(1  + 2)  + 3(3-  + 2) 

13  - z [6  + 3(i  + 2)  + 4 + ?)]  ' 

23  = ^6  + 3(1  + 2)  + l(l  + 


132 

36 

129 

36 

147 

36 


so  processing  1,3  first  is  optimal, 
nor  cu  • 

(ii)  n=2,s1=2  s2=1 

A = 3 w = 1 


It  is  neither  SEPT, 


,12 


.21 


■i[ 


1 W2  = 2 


3 + 6xl+lx 


3 + 3xl  + 2x 


ll  HI 

6 J = 210 

ll  266 
6j  210 


so  putting  task  2 on  1 and  1 on  2 is  optimal,  and  is  not 
SEPT  or  cu  . 


V 
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(5)  LEPT  Minimizes  Expected  Makespan 

The  makespan  is  the  time  from  0 until  all  tasks  are  completed. 
The  expected  makespan  is: 

M = E (T  ) * E (max  (C CM))  . 

N IN 


This  is  obtained  by: 


( 1 for  U i 0 

g(U)  = 

f 0 for  U = 0 


which  satisfies  the  conditions  of  Theorem  3. 

(6)  SEPT  Does  Not  Maximize  The  Expected  Makespan 

The  following  counterexample  shows  that  SEPT  does  not  maximize  the 
expected  makespan.  Take 


= 101 * * * * 6 *  for  1 <_  i <_  108 


A « =2 

108+1 


X 8 “ 1 
10+2 


We  have  2 identical  processors  and  allow  no  preemptions.  Then  the 

g 

schedule  1,2,  ...,  10  +2  gives  an  expected  makespan  of  approximately 

1 8 8ft 

51  -g-  and  the  schedule  10  + 1,1,2,  ...,  10  ,10  + 2 gives  an  expected 

makespan  of  51  ^ . We  conjecture  that  in  the  class  of  nonpremptive 

policies  the  following  schedule  is  optimal:  If  A,  > •••  > A„  there 

1 — — N 

exists  an  i , 1 <_  i < N , such  that  the  schedule  i,i  - 1, 

2,l,i  + l,i  +2,  ...,  N - 1,N  maximizes  the  expected  makespan. 
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(7)  Minimization  and  Maximization  of  Expected  Amounts  of  Work 

Let  M^,  . . . , be  the  total  times  during  which  processors 

1,  m are  occupied.  For  a fast  policy  = T^  , M2  = TN_^  , 

M = T,.  . (here  we  assume  m < N)  . The  amount  of  work  done  by 

m N-tn+1  — J 

processor  k is  then  s.  T_,  , , , . It  is  desired  to  minimize: 

k N-k+1 


W 

r 


( J,  ■ 


This  is  obtained  from 


g(U) 


+ s 


+ S| 


U|  > r 
U I < r . 


It  is  easily  seen  that  g satisfies  the  conditions  of  Theorem  3. 

Hence  W is  minimized  by  LEPT,  for  every  r (1  <_  r <_  m)  . Thus  we  have: 

LEPT  minimizes  the  expected  amount  of  work  done  by  processors 

1,  r (s^M^  + •••  + s^M^.)  , among  all  fast  policies. 

Also,  because  E(s,M,  + •••  + s M ) = — + •••  + , LEPT  maximizes 

11  m m A,  A 

1 N 

the  expected  amount  of  work  done  by  processors  r + 1,  ...,  m , among 
all  fast  policies. 


(3)  Maximizing  the  Expected  Life  Length  of  a Reliability  System 

Given  a series  system  of  m component  locations  and  N > m spares, 
where  the  spares  have  exponentially  distributed  life  lengths  with  parameters 
X^  <_  X,,  <_  •••  £ X^  and  the  component  locations  cause  wearout  at  rates 
s^  >_  •••  > , it  is  desired  to  allocate  spares  to  component  locations  so 

as  to  maximize  the  expected  system  lifetime.  The  problem  is  obviously 


• 
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equivalent  to  scheduling  N tasks  on  m processors,  where  only  fast 

policies  are  allowed  and  E(M  ) = E(T  ) is  to  be  maximized. 

m N-m+1 

Thus  (using  Case  (6)  with  r * m - 1)  , the  expected  lifetime  of  the 
system  is  maximized  when  the  best  remaining  component  (one  with  smallest 
X)  is  assigned  (preemptively)  to  location  1,  the  2nd  best  to  location  2, 
etc . 


I 
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6.  DISCUSSION 

We  have  derived  some  sufficient  conditions  on  the  cost  rate  g , 
under  which  SEPT  or  LEPT  minimize  total  expected  cost.  These  conditions 
include  the  requirement  that  g(<t>)  = 0 , g(U)  >_  g(V)  for  U D V . This 
means  that  cost  decreases  as  the  set  of  uncompleted  tasks  decreases, 
and  from  the  proof  of  Theorem  1 and  Lemma  1 it  seems  that  it  is  a 
necessary  condition  for  the  existence  of  an  optimal  policy  which  is  fast 
(both  SEPT  and  LEPT  are  fast). 

The  sufficient  condition  for  SEPT  to  be  optimal  is: 


g(U)  - g(Uk)  - gdy  + g(URa)  1 0 k ,i  e U . 


In  the  proof  of  Theorem  3,  this  is  used  to  show  that 


(28) 


Xk-1(G 


Gk-1> 


VG  - V 


and  it  seems  that  this  is  the  most  general  condition  under  which  (28) 
holds. 

The  sufficient  condition  for  LEPT  to  be  optimal  is  less  general, 
and  we  conjecture  that  it  is  enough  to  require: 


g(Uk)  < g(Ujl)  k < l , 


and 


g(U)  - g(Uk) 


s 

n 


g(y  - 3(uk.^ 

Sn-1 


k , l t U . 


One  generalization  of  the  problems  discussed  above  is  to  allow 


i 


arrivals  of  new  tasks.  We  conjecture  that  LEPT  remains  optimal,  since 
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it  minimizes  makespan  and  thus  will  yield  short  busy  periods. 

Another  direction  to  generalize  the  results  is  to  look  at  general 
distributions.  The  crucial  question  then  is  to  find  the  appropriate 

ft 

quantity  by  which  to  order  the  tasks.  For  a very  special  case,  mixtures 
of  two  fixed  exponential  random  variables,  SEPT  minimizes  flow  time 

and  LEPT  minimizes  makespan  [ 4 ] . 

I 
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